Members
Overall Objectives
Research Program
Application Domains
Highlights of the Year
New Software and Platforms
New Results
Bilateral Contracts and Grants with Industry
Partnerships and Cooperations
Dissemination
Bibliography
XML PDF e-pub
PDF e-Pub


Section: New Software and Platforms

Platforms

Platform MultiMod : Multimodal Acquisition Data Platform

Functional Description

Within a LORIA exploratory project (cf. 9.2.13), we have set up an acquisition hardware platform to acquire multimodal data in speech communication context. The system is composed of the articulograph Carstens AG501 (which was acquired as part of the EQUIPEX ORTOLANG - cf. 9.2.1), 4 Vicon cameras (a motion capture system), an Intel RealSense which is a depth camera (acquired as part of the project CORExp - cf. 9.1.1), a video camera and a microphone. With such heterogeneous hardware the synchronization is essential; this is achieved through a trigger device. All the data processing is performed with the PLAVIS software. This year, the system has been used to acquire multimodal data for the MCC project (cf. 9.4.2.1) and a first exploratory expressive multimodal corpus [40].